Intelligent Monitoring? Assessing the ability of the Care Quality Commission's statistical surveillance tool to predict quality and prioritise NHS hospital inspections
نویسندگان
چکیده
BACKGROUND The Care Quality Commission (CQC) is responsible for ensuring the quality of the health and social care delivered by more than 30 000 registered providers in England. With only limited resources for conducting on-site inspections, the CQC has used statistical surveillance tools to help it identify which providers it should prioritise for inspection. In the face of planned funding cuts, the CQC plans to put more reliance on statistical surveillance tools to assess risks to quality and prioritise inspections accordingly. OBJECTIVE To evaluate the ability of the CQC's latest surveillance tool, Intelligent Monitoring (IM), to predict the quality of care provided by National Health Service (NHS) hospital trusts so that those at greatest risk of providing poor-quality care can be identified and targeted for inspection. METHODS The predictive ability of the IM tool is evaluated through regression analyses and χ2 testing of the relationship between the quantitative risk score generated by the IM tool and the subsequent quality rating awarded following detailed on-site inspection by large expert teams of inspectors. RESULTS First, the continuous risk scores generated by the CQC's IM statistical surveillance tool cannot predict inspection-based quality ratings of NHS hospital trusts (OR 0.38 (0.14 to 1.05) for Outstanding/Good, OR 0.94 (0.80 to -1.10) for Good/Requires improvement, and OR 0.90 (0.76 to 1.07) for Requires improvement/Inadequate). Second, the risk scores cannot be used more simply to distinguish the trusts performing poorly-those subsequently rated either 'Requires improvement' or 'Inadequate'-from the trusts performing well-those subsequently rated either 'Good' or 'Outstanding' (OR 1.07 (0.91 to 1.26)). Classifying CQC's risk bandings 1-3 as high risk and 4-6 as low risk, 11 of the high risk trusts were performing well and 43 of the low risk trusts were performing poorly, resulting in an overall accuracy rate of 47.6%. Third, the risk scores cannot be used even more simply to distinguish the worst performing trusts-those subsequently rated 'Inadequate'-from the remaining, better performing trusts (OR 1.11 (0.94 to 1.32)). Classifying CQC's risk banding 1 as high risk and 2-6 as low risk, the highest overall accuracy rate of 72.8% was achieved, but still only 6 of the 13 Inadequate trusts were correctly classified as being high risk. CONCLUSIONS Since the IM statistical surveillance tool cannot predict the outcome of NHS hospital trust inspections, it cannot be used for prioritisation. A new approach to inspection planning is therefore required.
منابع مشابه
Wisdom of patients: predicting the quality of care using aggregated patient feedback
BACKGROUND The Care Quality Commission (CQC) is responsible for ensuring the quality of healthcare in England. To that end, CQC has developed statistical surveillance tools that periodically aggregate large numbers of quantitative performance measures to identify risks to the quality of care and prioritise its limited inspection resource. These tools have, however, failed to successfully identi...
متن کاملDevelopment and Psychometric Evaluation of Nursing Audit Tool
Background: Better healthcare outcomes in health services are obtainable from frequently observing ongoing healthcare activities, gathering data, and assessing outcomes. Objectives: This study aimed to establish the basic principles of nursing care standards and practices in wards, develop a nursing audit tool for periodically monitoring and controlling o...
متن کاملAuditing for patients.
sumer expectations and changing professionalpatient relationships. In the NHS, recent reforms involving, for example, the introduction of commissioning, clinical audit, and the patient's charter, have given an additional impetus to quality. Some of the Audit Commission's earlier work in quality of health care was outlined in the previous supplement'; this paper describes the commission's subseq...
متن کاملAssessing Post-Stroke Outpatients’ Rehabilitation Service Quality Gaps in Bangladesh
Objectives: The majority (80%) of stroke survivors in Bangladesh have lived with either minor or major physical, emotional, and cognitive disabilities. Due to patients’ poor perceived experience in healthcare services, participation in rehabilitation care has become a significant challenge for them. Consequently, it increases the burden of stroke disability. Therefore, this study aimed to measu...
متن کاملAssessment the Quality of Delivered Care for People with Atherosclerosis by Comprehensive Quality Measurement in Healthcare (CQMH) Model in Imam Reza Hospital Affiliated To Mashhad University of Medical Sciences In 2017
Introduction: Patient care quality is increasingly assessed as one of the important components of comprehensive management of chronic diseases and a tool for quality evaluation. The aim of this study was to evaluate the quality of care provided to patients with atherosclerosis through a comprehensive quality measurement model in health care. Methods: This cross-sectional study was performed on ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره 26 شماره
صفحات -
تاریخ انتشار 2017